Multimodal Interaction with a Virtual Guide
نویسندگان
چکیده
We demonstrate the Virtual Guide, an embodied conversational agent that gives directions in a 3D environment. We briefly describe multimodal dialogue management, language and gesture generation, and a special feature of the Virtual Guide: the ability to align her linguistic style to the user’s level of politeness.
منابع مشابه
MATCHkiosk: A Multimodal Interactive City Guide
Multimodal interfaces provide more flexible and compelling interaction and can enable public information kiosks to support more complex tasks for a broader community of users. MATCHKiosk is a multimodal interactive city guide in which users are free to interact using speech, pen, touch or multimodal inputs and the system responds by generating multimodal presentations that synchronize synthetic...
متن کاملMultimodal Applications from Mobile to Kiosk
Multimodal interfaces provide more flexible and compelling interaction and can enable public information kiosks to support more complex tasks for a broader community of users. MATCHKiosk is a multimodal interactive city guide which provides users with the freedom to interact using speech, pen, touch or multimodal inputs. The system responds by generating multimodal presentations that synchroniz...
متن کاملLearning through Multimodal Interaction
This paper proposes and implements a new experimental paradigm to study the role of multimodal interaction in automatic language learning. We observe that child language acquisition relies significantly on everyday social interactions with adult partners. In light of this, we argue that an important step to build machines that can also learn from social interactions with human users is to under...
متن کاملA Multimodal Real-Time Platform for Studying Human-Avatar Interactions
A better understanding of the human user’s expectations and sensitivities to the real-time behavior generated by virtual agents can provide insightful empirical data and infer useful principles to guide the design of intelligent virtual agents. In light of this, we propose and implement a research framework to systematically study and evaluate different important aspects of multimodal real-time...
متن کاملUsing Virtual Humans to Study Embodied Social Interaction
An important step to build machines that can learn from social interactions with human users is to understand the nature of learning-oriented interactions. To do so, a central problem is to find a way to decouple the social interaction between two agents (e.g. a human supervisor and a machine learner), so that we can systematically manipulate and control the dynamic flow of the interaction to c...
متن کامل